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Exotic phase diagram of a topological quantum system 

Xiao-Feng Shi, Yan Chen, and J. Q. You 
Department of Physics and State Key Laboratory of Surface Physics, Fudan University, Shanghai 200433, China 

(Dated: November 16, 2010) 

We study the quantum phase transitions (QPTs) in the Kitaev spin model on a triangle- 
honeycomb lattice. In addition to the ordinary topological QPTs between Abelian and non-Abelian 
phases, we find new QPTs which can occur between two phases belonging to the same topolog- 
ical class, namely, either two non-Abelian phases with the same Chern number or two Abelian 
phases with the same Chern number. Such QPTs result from the singular behaviors of the nonlocal 
spin-spin correlation functions at the critical points. 



I. INTRODUCTION 

A quantum phase transition (QPT) involves an abrupt 
change of the ground state in a many-body system due to 
its quantum fluctuations. 1 Discovering and characteriz- 
ing new QPTs in a two-dimensional topological quantum 
system have recently attracted considerable interest £~— 
Because the ground states in some topological quantum 
systems (e.g., the Kitaev spin models on honeycomb 3 
and triangle-honeycomb 5 lattices) are exactly solvable, 
QPTs in these systems can be analytically investigated. 
In these topological systems, the discovered QPTs in- 
clude the transition between a gapped Abelian phase and 
a gapless phase ^^ the transition between Abelian and 
non-Abelian phases ^r— and the transition between two 
non-Abelian phases with different Chern numbers. 3 Also, 
an unconventional QPT between two non-Abelian phases 
was foundii in the Kitaev spin model on a triangle- 
honeycomb lattice by a fermionization method. Never- 
theless, to the best of our knowledge, the QPT between 
two topological phases of the same Chern number (which 
belong to the same topological class) has not yet been 
found. 
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Here we show that, in the Kitaev spin model on a 
triangle-honeycomb lattice, a QPT can indeed happen 
between two gapped phases in the same topological class, 
in addition to the ordinary topological QPT between two 
phases of different Chern numbers. To demonstrate this, 
we focus on two parameter regimes as typical examples: 
(i) When the parameters vary across a critical curve sep- 
arating two gapped phases of the same Chern number 
y = 0or ±1, a first-order QPT occurs; (ii) when the pa- 
rameters vary across a special critical point where several 
critical curves meet, a continuous QPT can occur. This is 
due to the exotic ground-state phase diagram which has 
either critical curves between two gapped phases (with 
the same or different Chern numbers) or critical points 
where four different gapped phases (with Chern numbers 
0, 0, 1 and —1) terminate. These results reveal that 
the Kitaev spin model on a triangle-honeycomb lattice 
exhibits novel topological properties. Moreover, we find 
that such QPTs result from the singular behaviors of the 
nonlocal spin-spin correlations at the critical points. 

The paper is organized as follows. In Sec. II, we present 
the solution for the ground state of the Hamiltonian in 
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FIG. 1: (Color online) (a) A schematic illustration of the Ki- 
taev spin model on a triangle-honeycomb lattice. Each unit 
cell (dotted diamond) contains six spins at sites 1,2,- • -,6. 
The six types of bonds are labeled by J a and J' a , where 
a — x,y, z. (b) Schematic diagrams of the three plaquette 
operators Pq, Pi, and P2, which are defined in Eq. ([2]). 



the uniform-flux sector. Sections III and IV show two 
typical phase diagrams of the ground-state wavefunctions 
and study various QPTs in the considered Kitaev spin 
model. Finally, a brief conclusion is given in Sec. V. 



II. GROUND STATE IN THE UNIFORM-FLUX 
SECTOR 

The Kitaev spin model on a triangle-honeycomb lat- 
tice is schematically shown in Fig. QJa) and the model 
Hamiltonian is given by 



H = J * E °i°l+ J v E °i°l + J' E ct ^i 

s-link y-link z-link 

+J' X J2 v!<r* + Jy E CT M + ^ E <**]■. 

a; '-link y'-link z'-link 



(i) 




FIG. 2: (Color online) The ground-state phase diagram of 
the Kitaev spin model on a triangle-honeycomb lattice, (a) 



Ai = J'x/Jx, and A2 = Jz/Jx, when J x = 
and J Z J' X - J' Z J X . (b) A x = J x /J z , and A y 
J — J' J 

'J X U x , Uy 



J V - V 
= J y /J z , when 



J y , and J z — J' z . The solid curves or lines 
correspond to gapless phases. The yellow (red) regions in 
(a) and (b) correspond to gapped phases with Chern number 
v — 1 ( — 1). The white regions are gapped phases with Chern 
number v — 0. 



where af, with a — x,y and z, are the three Pauli op- 
erators at site i. Among the six sums in Eq. ([T]), four 
involve interactions within each unit cell (see Fig. [TJ: (i) 
The ir-link couples either spins 2 and 3 or spins 5 and 6, 
(ii) the y-link couples either spins 1 and 3 or spins 4 and 
6, (hi) the z-link couples either spins 1 and 2 or spins 4 
and 5, and (iv) the z'-link couples spins 3 and 6. Nearest- 
neighbor unit cells are coupled by the x' - and j/'-links. As 
found in Ref. y, the ground state of Hamiltonian ([1]) is at 
least 8 (6)-fold degenerate for the Abelian (non-Abelian) 
phase. 

For the three types of hermitian plaquette operators 
defined by [see Fig. Hfb)] 



is a function of variable e^ (see Appendix A). One can 
prove that Hamiltonian (J3|) breaks time reversal symmc- 

(s) 

try from the property of Majorana fermions c k . This is 
in sharp contrast to the Kitaev model on a honeycomb 
lattice in which the time reversal symmetry is preserved. 
This is due to the difference between the bipartite nature 
of the honeycomb lattice and the non-bipartite nature of 
the triangle-honeycomb lattice. Hamiltonian ([3]) has six 



energy bands: e k 



(i) 



.(6) 



-£ k , £ 



(2) 



.(5) 



and 



-(3) 



_(4) 



e k , with £k 



> 4 > 



> 0. 



In each unit cell, six Majorana fermions are defined, 
but the number of the corresponding fermions are three. 
Thus, the lowest three bands should be filled for the 

ground state: \g) = IlkE^i V2A^\0), with \/2 the 
normalization factor which results from the fact that the 
fermion Ay is constructed from Majorana fermions in k 
space, each of whom can only take 1/2 as its occupation 
number. The ground-state energy per site is given by 



E„ 



1 

li.V 



Ei 



.(1) , J2) 



.(3) 



where TV is the num- 



ber of unit cells. The energy-band gap, i.e., the mini- 
mal energy to excite a fermion from the ground state is 



A = 



-(4) 



— e 



(3)1 



where 



denotes the minimal 



value of a function with variable k. 

Below we show the ground-state phase diagrams in two 
different parameter regimes. The first diagram contains 
critical curves separating two phases of either the same 
or different Chern numbers. This unveils that QPTs can 
also occur in the same topological class. The second dia- 
gram contains critical points where four different phases 
with Chern numbers 0, 0, 1 and —1 terminate. 
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III. 



CASE A: J x = J y , J' x = J y , AND J Z J X = J'J X 



each has eigenvalues ±1. These plaquette operators com- 
mute with not only each other but also the Hamiltonian 
([!]). As verified in Ref. [3. the ground state of Hamil- 
tonian |l| is either in the sector of the Hilbert space in 
which all plaquette operators in Eq. ([2]) have eigenvalue 
one or in the sector where the time-reversal transforma- 
tion of each plaquette operator in Eq. @ has eigenvalue 
one. The former is denoted as the uniform- flux sector^ 
By using the Jordan- Wigner transformation, Hamilto- 
nian (|T|) can be converted to a form represented by Ma- 
jorana fermions. 5 Performing Fourier transform on the 
Hamiltonian in the uniform-flux sector, we obtain 



Hi, 



3=3 



-0) 



keBZj=i 



2A 



(m A u) 



A>> 1 



(3) 



where BZ denotes the first Brillouin zone. In Eq. ([3]), 



.Wt 



» 



J^ s=1 c k w s are fermionic operators, where c 



(«) 



is the Fourier transform of the Majorana fermionic op- 
erator at site s (s = 1, 2, • • • , 6) in a unit cell, and w s 



We first choose parameters Ai = J' x /J Xl and A2 = 
Jz/ Jx to study the ground-state property of the system. 
In particular, the parameters with A2 = 1 and Ai > 
correspond to the case studied in Ref. where a topolog- 
ical QPT between an Abelian phase and a non-Abelian 
phase was found at point Ai = v3. There is also a per- 
turbative study— of this model with parameters either 
Ai < 1 or Ai > 1 when A 2 = 1. 

In order to find the ground-state phase diagram of 
the Kitaev spin model, we should first distinguish the 
gapless-phase regions from the gapped-phase regions in 
the phase diagram. Then, we calculate the Chern 
numbe r 14 ! 15 as a topological index to characterize each 
gapped-phase region. We note that the six energy bands 



satisfy the relation e 



U) 



1-r-i) 



where j — 1,2,3, 



which implies that the closing of the energy-band gap cor- 



responds to either 



-(3)1 



or 



,(4)i 



0. 



bining this condition with the relation e k 

r6 



U) 



we can derive that if one has 



n 



,-.«?] 



Com- 

,(7-i) 
'k ' 

0, the 



energy-band gap is zero, i.e., A = 0. This gives rise to 



A, 



0; A 2 = 0; A? 



A\± 



|A 2 



(4) 



where + (-) applies when |Ai| > |A 2 | (|Ai| < |A 2 |). In 
Fig. Ufa), each gapless phase determined by Eq. (U) is 
schematically shown by a solid curve or line. One can see 
that the AiA 2 plane is divided into 12 distinct regions by 
these solid curves or lines. Each of these 12 regions is a 
gapped topological phase and can be characterized by a 
Chern number. 

We can define the Chern number by using the Berry's 
phase for a gapped ground statej 14 i 15 Among the six 
bands of Hamiltonian Q, the lower three bands with 

states \j, k) = y/2A-£' |0), where j = 1,2,3, are occu- 
pied. The Berry's phase gauge field in momentum space 

is 



: E(*k 



/«(k) 



where a = x,y. This gives 

1 6 3. 

v = -ImVV / d 2 k 



o 



0k o 



J,k 



(5) 



dwt(e^)dw s (e^) 



dk x 



dk y 



,(6) 



where Im denotes the imaginary part of a complex vari- 
able. Numerical results show that each yellow (red) re- 
gion in Fig. Ufa) corresponds to a gapped non-Abelian 
phases with Chern number v = 1 (—1). The other 8 white 
regions correspond to the Abelian phases with v = 0. A 
remarkable feature is that a critical curve or line (i.e. gap- 
less phase) can separate two gapped phases with Chern 
numbers v = (i) and ±1, (ii) and 0, or (iii) 1(— 1) 
and ±1. This reveals that a QPT can occur between two 
gapped phases belonging to the same topological class. 

Below we explicitly display the QPTs (see Fig. |3|). As 
in Ref. [la, here we classify the QPTs as two types: The 
first-order QPT where the first derivative of the ground- 
state energy E g with respect to the driving parameter 
is discontinuous at the transition point, and the contin- 
uous QPT where a higher-order derivative of E g is dis- 
continuous and the derivative(s) with order(s) lower is 
(are) continuous. Figure[3fa) [3fb)] shows that there is a 
first-order QPT between two phases of the same Chern 
number v = 1 (0) at (A x , A 2 ) = (0, 1) [(0, 2)], when 
one parameter varies along the horizontal dashed (dot- 
ted) line in Fig. [2f a) . Using the perturbation method in 
E3, the effective Hamiltonian at Ai ~ can be obtained, 
up to third order, as (see Appendix B) 



H cS = H™ + M J2 [Px{n)a^y k + P 2 (n)af,a],oi, 



(7) 



(3) 



where n denotes the nth unit cell, Pq is a term contain- 
ing none of Pq, Pi or P 2 , and the subscripts i,j, and k 
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FIG. 3: (Color online) Chern number v, the ground-state 
energy E g and its derivatives, and the spin-spin correlation 
function C z and its derivative with respect to the driving pa- 
rameter, (a) A = Ai and A 2 = 1; (b) A = Ai and A 2 = 2; 
(c) A = A 2 and Ai = 1. The parameters in (a), (b) and (c) 
correspond to the horizontal dashed, horizontal dotted and 
vertical dashed lines in Fig. Ufa). 



(i 1 ,j' ', and k') denote the sites linked to plaquette Pi (P 2 ) 
with x-, y- and z-link, respectively. For the QPT between 
two phases of the same Chern number, the parameter Ai 
changes its sign at the transition point Ai =0. This 
gives rise to different P c ff 's at the two sides of the tran- 
sition point Ax = 0. Also, the difference between the two 
phases of the same Chern number but with positive and 
negative Ai's can be seen from their wavefunctions (see 
Appendix A). 

Using Feynmann theorem, 9 it can be derived that 



^ = l {Cx + C v + A 2 C z ), 



(8) 



where the spin-spin correlation functions are defined by 
C a = (gWi<rf\g)a'-UT>k, with a = x,y and z for a 1 = x', y' 
and z'. It is clear that the discontinuity of dE g /dAi at 
a QPT point results from the discontinuity of C a there. 
Here we find that, at the QPT point, the nonlocal spin- 
spin correlation function on the x'-, y'-, or z'-link changes 
its sign, displaying discontinuity there. As shown in Fig. 
[3fa) [Fig. |3fb)], C z indeed has a jump at the QPT point 
(Ai, A 2 ) = (0, 1) [(0, 2)] when A 1 changes from positive 
to negative. It should be noted that only part of the 
spin-spin couplings in the Hamiltonian ([T]) change their 
sign at these transition points, while the other spin-spin 
couplings are kept unchanged. 

In addition to the first-order QPTs, continuous QPTs 
can also occur in the Kitaev spin model on a triangle- 
honeycomb lattice. As shown in Fig. [3] (a), dE g /dAi 





curves determined by 



n-=i4 3) ]=0are 



FIG. 4: (Color online) Chern number v, the ground-state en- 
ergy E g , the spin-spin correlation function C x , and the deriva- 
tives of both Eg and C x with respect to the driving parameter 
A x . The parameters in (a) and (b) correspond to the dashed 
and dotted lines in Fig. [2^b). 



and d 2 E g /dA\ are continuous while d^E g /dA\ becomes 
discontinuous at (Ai, A2) = (±V3, 1). This corresponds 
to a topological QPT between Abelian and non-Abelian 
phases. Figure [3jb) shows that such a continuous QPT 
can also happen at (Ai, A 2 ) = (±\/3, 2) or (±-\/5, 2). 
Similar to the first-order QPTs, the continuous QPTs 
result from the discontinuity of the second derivative of 
spin-spin correlation functions at the critical point. 

Figure |3fc) displays three continuous QPTs. Interest- 
ingly, the QPT at (Ai, A 2 ) = (1, 0), where d 2 E g jdA\ 
diverges, occurs between two non-Abelian phases with 
Chern numbers 1 and — 1, respectively. This is in sharp 
contrast to the other two QPTs occurring at Ai = 1 and 
A2 ~ ±1.5, where d^Eg/dA^ is discontinuous and each 
transition is between Abelian and non-Abelian phases, 
instead of two non-Abelian phases. Also, it can be de- 
rived that 



dE a 
dA 2 



{B Z +A 1 C Z 



(9) 



where B z = (.<?|of a^|g) z -imk- This unveils that the non- 
analyticity of E g results from the nonanalyticity of either 
B z or C z . Indeed, Fig. [3jc) shows that dC z /dA 2 is di- 
vergent at (Ai, A2) = (1, 0). Such a QPT between two 
phases of Chern numbers v = ±1 can also occur when 
changing the sign of the magnetic-field-related parameter 
n in the Kitaev spin model on a honeycomb latticed 



IV. CASE B: J a = J' a , WHERE a = 



x, y. 



AND z 



|A„| = ^--Tf-yTf+Tf, |A X |>|A,|; (10) 
|A»| = \/t 2 '+T 1 --{/t 2 --T 1 -, l^lA.UAJ. 



Here we use parameters A^ = J x /J z , and A y = J y /J z 
to characterize the phase diagram. The gapless-phase 



Here if = (l±|A x | 3 )/2, and if = ^ff T (|A*|/3)3. 
The gapless phase determined by each condition in 
Eq. (jlll) is shown by a solid curve in Fig [2jb) . These 
gapless-phase curves divide the A^Ay plane into 9 re- 
gions: Two phases of Chern number v = 1 ( — 1), denoted 
by yellow (red) regions, and five gapped phases of Chern 
number v — 0, denoted by white regions. In this phase 
diagram, four gapped phases with v = 0, 0, 1 and —1 all 
terminate at a gapless-phase point (A x , A y ) = (0, ±1) or 
(±1,0). Such a point is analogous to the eutectic point 
in crystallography. Also, a similar critical point exists in 
the phase diagram of the Haldane model Ji 

Below we focus on the QPTs at the points where dif- 
ferent gapped phases terminate. When A^ varies along 
the dashed line in Fig. HJb), a continuous QPT occurs at 
point (A x , A y ) = (±1,0), where d 2 E g /dA x diverges [see 
Fig. Ufa)]. Similar to the QPT between two non-Abelian 
phases belonging to the same topological class, this QPT 
involves two Abelian phases with the same Chern number 
v = 0. When A x varies along the dotted line in Fig. HJb), 
in addition to the continuous QPTs between Abelian 
and non-Abelian phases (which occur at A^ w ±1.5 and 
A y = 1, where d 3 E g /dA^ are discontinuous), a contin- 
uous QPT between two non-Abelian phases happens at 
point (As,, A y ) — (0, 1), where d 2 E g /dA 2 x diverges. In 
contrast to the QPT between two non-Abelian phases 
belonging to the same topological class, this transition in- 
volves two non-Abelian phases with v = ±1. Analogous 
to the first-order QPTs occurring in the same topologi- 
cal class (Fig. [3]), the continuous QPTs here are also due 
to the singularity of the nonlocal correlation functions at 
the critical points (see, e.g., the thick solid curves in Fig. 

a. 



V. CONCLUSION 

We have studied QPTs in the Kitaev spin model on 
a triangle-honeycomb lattice and revealed the exotic 
ground-state phase diagram of this model. In addition 
to the ordinary topological QPTs between Abelian and 
non-Abelian phases, we find new QPTs that occur be- 
tween two phases belonging to the same topological class. 
Moreover, we show that such QPTs are due to the singu- 
lar behaviors of the nonlocal spin-spin correlation func- 
tions at the critical points. 
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FIG. 5: (Color online) The triangle-honeycomb lattice in 
Fig. (Ha) is deformed to a topologically equivalent lattice, so 
as to label each site by row and column indices. In each unit 
cell, the three sites denoted by 3, 4, and 5 have row and col- 
umn indices m and n with m + n equal to an even integer, 
and the other three sites denoted by 1, 2, and 6 have row and 
column indices with m + n equal to an odd integer. 
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Appendix A 

1. Derivation of the ground state in the 
uniform-flux sector 

The Kitaev spin model on a triangle-honeycomb lattice 
is schematically shown in Fig. [5] and the model Hamilto- 
nian is given by 

H = J x £ Ofof + Jy E "M + J * E ^ 

y-link 



m-link 



2-link 



+4 E <°1 + J v E ^M + J * E <** 

a;'-link y'-link z'-link 

(Al) 

To use the Jordan- Wigner transformation, we need to 
label the sites by row and column indices. We deform 
the honeycomb lattice [see Fig 1(a)] into the topologically 
equivalent one in Fig. [5] Now each site can be labeled 
by (to, n), where to (— 1, 2, • • • , M) and n (= 1, 2, • • • , N) 
are the row and column indices, respectively. 

By performing the Jordan- Wigner transformation 18 

N 

0-m.n = 2a ln,n ]J H °2»' >' II ^.n" ( A2 ) 
n' — lm'<m n" <n 

on each spin, and using the Majorana fermions 

c m,n = l \ a m,n ~ a m,n)j d mn = a mn + dm.n (^o) 

for sites s = 3, 4, 5, and 

C m,n = a m,n "i a m,rn d mn = H a m,n — a m _ n ) (A4) 



for sites s = 1, 2, 6 in each unit cell [see Fig. [5], the Hamil- 
tonian (jAlj) is converted to 



ff = iJ, 



-iJ, 



V r< 3 > c (2) + V c^ c (6) 

/ j m,n m, n+1 / ^ m,n m,n+l 

x-link(A) a;-link(v) 



V c^ c (3) + V 



r (6) r (4) 



(4) „(1) 
m, n^m, n+1 



(2) .(5) 



j/-link(A) 
x / C rM ^ C, 

y'-link,n^./V 
Af/2 

™ C 2m,iV C 2m,l 
m— 1 
M/2 



y-link(v) 






^ B E ^ 



m—l 



,(2) 



(5) 



2m-lC 2m _ 1 7v C 2m-l,l 



+i7 V id (1) d (2) c (1) c (2) 

z / y tu m,n u, Tn,n+2 m,ra'--m,,n-)-2 
z-link(A) 

+il V id (4) d< 5 > c (4) c< 5 > 

' z Z_^ la m,n+2 u, m,n^m,n+2 L 'm,n 
z-link(v) 

' <" J z / j lu 'm,n u 'm+l,n u m,n u m+l,m 



(A5) 



^'-link 



where $ Xim = Y\ n=1 <Jm,n^ m = i, 2 ,---, or M, is 
the global flux operator calculated along a given con- 
tour encircling the system in the horizontal direction, 
a-link(A) denotes the a-link in an up-pointing triangle, 
and a-link(v) the a-link in a down-pointing triangle. 

The global flux operator calculated along a given con- 
tour encircling the system in the vertical direction, which 
does not appear in the Hamiltonian (|A5I) . is given by 



$„ 



M/2-1 

ny x z z 

(J l+2m,n' J 2+2m,n (J 2+2m,n+l (J 2+2m,n+2 



^ a 2+2m,n+3 a 3+2m,n+3 a 3+2m,n+2 a 3+2m,n+l 

M/2-1 

/ nf TT JV A 

l-J-J 11 «l+2m,n"2 



7 (3) j(6) ,(3) 

l 2+2m,n u 2+2m,n+3 



j(6) 

i 3+2m,n+3' 



(A6) 



where n = 1 + Qr with r = 0, 1, • • •, or iV/6 — 1. These 
two global flux operators $> x ,m and ^ v>n commute with 
Hamiltonian (|A1|) . This leads to a topological degeneracy 
for the ground state because <& x ,m and $j,, n can have 
eigenvalues either 1 or — 1. For the Abelian phase, this 
degeneracy is 4-fold because (& x ,m, <&y,n) can be (1,1), 
(1,-1), (—1,1), and (—1,-1), while the degeneracy is 
3-fold for the non-Abelian phase since ($ x ,m, &y,n) — 
(—1,-1) is not allowed^ In addition to the global flux 
operators, the three types of local plaquette operators 
Pq, Pi, and Pi also commute with Hamiltonian (|A1I) . 



Using the Jordan- Wigner transform, they can be written 
as 

Pn(m n) - d^ d {6) d {3) d {6) 

®Pi(m, n + 2)P 2 (m + 1, n + 2), 



Pi{m',n) = id£, , +2 d. 



,(5) 



+2 u 'm',n'> 



P 2 (m",n") = id%, >n „d { 3, n „ 



+ 2" 



(A7) 



where (m,n), (m',n'), and (m",n") correspond, respec- 
tively, to the sites denoted by 3, 5, and 1 in each unit 
cell. As shown in Ref. [f|, the ground state lies in the 
sector of the Hilbcrt space where either (i) P (m,n) = 1 
and Pi{m',n') = P 2 (m",n") = 1 or (ii) P (m,n) = 1 
and Pi(m',n') — P^m" , n") = — 1. In each of these two 
sectors, the time reversal symmetry of Hamiltonian (|A1[) 
is broken. The former is called as the uniform-flux sec- 
tor. This means that the ground state has another 2-fold 
degeneracy due to this broken time reversal symmetry, in 
addition to the topological degeneracy discussed above. 
Thus, we have 8-fold (6-fold) degeneracy for the ground 
state in the Abelian (non-Abelian) phase, corresponding 
to 8 (6) flux configurations for $ x>m , ®y,m P), -Pl, an d Pi- 
Here we focus on the ground state in the uniform- 
flux sector with (§ x ,m, &y,n) — (1, 1), which allow both 
Abelian and non-Abelian phases^ Note that only one 
ground state exists in this sector. Now, Hamiltonian (|A5[) 
is reduced to 



~"~ z / i C m,n c m,n+1 l "y / t C ' 

y'-link 



-link 
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By using the Fourier transform 
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which satisfies 



{c r s \ £>'>} = 25 r ,r>6 s , s >, {£\£ ) } = 6 k ,- V 6. 



(A10) 
where BZ denotes the first Brillouin zone, 8=1, 2, • • • , 6 
denote the six sites in each unit cell, and r is the position 
of a unit cell, Eq. (IA8[) becomes 
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where c_ k = C k , and the two basis vectors of the unit 
cell are ei = e x /2—y/3e y /2, and e 2 = e x /2+y3e y /2. To 
obtain the quasi-particle spectrum, we write Eq. (IA11[) 
as 



where $,' 
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From the eigenvalue equation Pk^ = Ek*, one has 
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where 
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The solution of Eq. (|A14|) reads 
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with 
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With the six energy bands in Eq. (|A17[) . the Hamilto- 
nian (|A13|) can be written as 
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where ^ = S«=i c k w s( £ k ) ^ s a fermionic operator, 
with Cjj the Fourier transform of the Majorana fermionic 
operator at site s (s = 1, 2, • • • , 6) of the unit cell, and 
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In order to find the ground-state wavefunction for 
Hamiltonian (|A19|) . we should first define the vacuum 

|0)by 



O m>n |0) = 0, 



(A23) 



where a mn is the fermionic operator defined in Eq. (|A2[) . 
and the index (m, n) runs over every site of the lattice. 
From Eqs. (|A"3|) and (|AT| . we have 
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For state |j, k) = v^^ |0) in the occupied band, it is 
normalized as 

(j,k|j,k) = (0\V2A^V2A^\Q) 



In Eq. (TMOl) . 
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which clarifies that the normalization factor V2 is due 
to the fact that the occupation number can only take 
1/2 for the Fourier transform of each Majorana fermion 
[see Eq. (|A25|) ]. Hence we can write the ground-state 
wavefunction as 



i.9)= n n^4 j)t i 

keBZj=l 
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The corresponding ground-state energy per site is 
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2. Two different ground states in the same 
topological class 

Below we show that the quantum phase transition 
(QPT) between two phases belonging to the same topo- 
logical class is nontrivial. For example, in the case of 
J x = J yi J' x = J' y , and J Z J' X = J' Z J X , the QPT that 
occurs when Ai = J x /J x varies across the critical line 
Ai = does not change the topological class of the 
ground state, i.e., the QPT occurs between either two 
non-Abelian phases with Chern number v — ±1 or two 
Abelian phases with v = 0. By using the parameters 
Ai = J' x /J x and A 2 = J z /J x , Eq. (|A21|) can be reduced 
to 
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where e^ i s m units of J x . These w' s satisfy 

w' s (-A 1 ,A 2 ) = -^(A!,A 2 ), s= 1,2,3; 



(A30) 



w 



(-Ai,A 2 ) = <(Ax,A 2 ), s = 4,5,6. (A31) 



From A^ = E s =i c k "'sft )> where w s are given 
in Eq. (|A20|) . we can define an analytical function 
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From Eq. (|A31|) . it follows that 
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Equations (|A32[) and (|A33|) show that the ground state 
\g(Ai, A 2 )) is mapped to |g(— Ai, A 2 )) when c^ , s = 1,2, 

and 3, are changed to — c^ . Because ci 8 , s = 1,2, and 
3, are the Fourier transform of the Majorana fermions 
Cr defined on sites 1, 2, and 3 in each unit cell (i.e., all 
the triangles related to plaquette operator P^). The 
transformation o£ — > — c k corresponds to a tt phase 

(s) 

change to each of the Majorana fermions Cr at sites 
s = 1,2, and 3. Note that the two ground states 
|ff(A i, A 2 ) ) and |g(-Ai,A 2 )) arc different [seeEqs. (|A32|) 
and (|A33|) ]. although the energy spectrum of the Hamil- 
tonian _ff(Ai,A 2 ) is symmetric about the critical line 
Ai =0. 



Appendix B: Effective Hamiltonian 

In order to show that both the QPTs between two 
Abelian phases and those between two non-Abelian 
phases are nontrivial, we use the perturbation method 
in Ref. [3j to derive the effective Hamiltonian at A 4 ~ 0. 
In this case with J x — J y , J' x = J', and J Z J X = J' z Jx, we 
characterize the phase diagram by the two parameters 
Ai = J x /J x , and A 2 = J z /J x . We assume J x > and 
take it as the unit of energy. 

The Hamiltonian of the system can be written as 



H = H + V, 
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where V is a perturbation. 



As in Ref. y, we calculate the effective Hamiltonian as 



H eS = T\V + VG' V + VG' Q VG' V + ---)T 
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where T maps the effective Hilbert space onto the 
ground-state subspace of Hq and G' is the Green func- 
tion for excited states of Hq. The ground state of Hq is 
a direct-product state consisting of the ground states of 
the following Hamiltonians: 
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defined on down-pointing and up-pointing triangles [see 

Fig.HTb)]. 

In Eq. (HH, H^ = rVr is obtained as 



HU = Al ( E <-i+ E «+ A ^ E -H 
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As in the perturbation method used for the Kitaev model 
on a honeycomb lattice in the presence of a week mag- 
netic field,— in order to derive H ^ = T^VG' VT, we 
assume that all the involved excited states of the system 
have a gap e ~ |A 2 | above the ground-state energy. This 
gives rise to 



H (2) 



MNK 



6|A 2 



i(2 + A^) 



a^'-link y'-link 

A?A 2/ v. 



Z^ CT fe CT i 



„x „x\ ( 



c'-link .s'-link 






|A 2 



|A a 



Z^ "M)( 2^ °fc°T 



(B6) 



y'-link 



-link 



It is interesting to note that though H^ involves even 
number of spin operators, it is not invariant under a time 
reversal transformation in the uniform-flux sector. Take 
one sum in the second line of Eq. (|B6|) as an example: 
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tt{2) _ fVl V^ „xxvv 

1 Zl (jfe)=z-link 

= ~w\ £ (°M<x°M> ( B7 ) 

1 2| {ifc)=z-link 

where (j,k,m) denotes the three sites in either a down- 
pointing or up-pointing triangle, which is labeled by ei- 
ther (2,1,3) or (1,3,2) in Fig. \2b). Namely, ^a v k a z m 
is either the plaquette operator P\ or P%. Since the 



eigenvalues of P\ and Pi are both chosen to be 1 in the 

(2) 

uniform-flux sector, H v can be reduced to involve only 
three spin operators in this sector and the time rever- 
sal symmetry is now broken. Thus, in the uniform-flux 
sector, one has 



thWt-^hw, 



(B8) 



where T is the time reversal transformation. Similarly, 
ff(3) = T^VG' VG VT can be obtained as 



(3) _ Aj(l+Aj)MA 
2K\MN 



x'-link 



y'-link 



3A 2 



E ^ 



-link 



6A? 

+ A, 



E 

(il,i2,i3)#A,v 



<^<^<^3 



(B9) 



Here (ii,ji) are the two sites connected by an a/-link, 
(*2)j2) are the two sites connected by a y'-link, and 
{is, 33) are the two sites connected by a z'-link. 

6A 3 
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where v(^) runs over all down-pointing (up-pointing) 
triangles with (m, n) denoting the site 5 (1) in each unit 
cell (see Fig. [5]). By summing over H^\H^ and H^ 3 \ 
the effective Hamiltonian, up to the third order, is given 
by 



H, 
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6A 3 
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r(3) 



where i?Q is a term involving none of the plaquette op- 
erators Pi, i = 0, 1 and 2. 

For the QPT between two phases of the same Chern 
number, the parameter Ai changes its sign at the tran- 
sition point. This yeilds the change of signs in certain 
terms in the effective Hamiltonian. Therefore, the effec- 
tive Hamiltonian H c s is different at the two sides of the 
transition point Ai = 0. 
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